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Abstract 

In this paper, adaptive set-point regulation controllers for discrete¬ 
time nonlinear systems are constructed. The system to be controlled is 
assumed to have a parametric uncertainty, and an excitation signal is used 
in order to obtain the parameter estimate. The proposed controller be¬ 
longs to the category of indirect adaptive controllers, and its construction 
is based on the policy of calculating the control input rather than that of 
obtaining a control law. The proposed method solves the adaptive set- 
point regulation problem under the (possibly minimal) assumption that 
the target state is reachable provided that the parameter is known. Ad¬ 
ditional feature of the proposed method is that Lyapunov-like functions 
have not been used in the construction of the controllers. 

keywords adaptive set-point regulation, discrete-time nonlinear systems, per¬ 
sistent excitation 


1 Introduction 

For decades, adaptive control of nonlinear systems has been an active area of 
research, and several design methods have been established for both continuous¬ 
time and discrete-time systems mm- A majority of these design methods 
first assume that the systems are described in some canonical forms and that 
parametric Lyapunov-like functions are known; they then construct controllers 
together with tuners of specific forms to obtain sufficient conditions for the 
stability of the closed-loop system. In other words, their sufficient conditions 
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are “method driven. ” Therefore the question naturally arises: what is a nearly 
minimal sufficient condition for a nonlinear system with parametric uncertainty 
to permit stable adaptive controllers? The present paper is an attempt to answer 
this question. 

The objective of this paper is to construct adaptive controllers for discrete¬ 
time nonlinear systems that drive the state of the system into a neighborhood of 
a “target state” by finite-time control under the assumption that the target state 
is finite-time reachable if the parameter is known. We assume a certain kind 
of parameter identifiability (the precise statement is given below) together with 
an excitation signal, and we construct the controllers by following the policy of 
calculating the control rather than that of obtaining a control law, assuming 
that numerical solutions of nonlinear equations are available either exactly or 
with the desired accuracy. The proposed method is not supposed to be used 
in consecutive operations - it is assumed that the controllers terminate if the 
state reaches a neighborhood of the target state, and the parameter estimate is 
used for other purpose (e.g. for parametric local stabilizing controller). 


2 Definitions and notations 


Consider a discrete-time nonlinear system with parametric uncertainty of the 
form 

x(t+l) = f(x(t),u(t),6), (1) 

where x{t) £ R™ is the state, u(t) £ M n “ is the control input, and 9 £ R” e is the 
parameter to be estimated. The parameter 6 is assumed to be inside a compact 
and convex set f lg, and the function / is assumed to be C 1 with respect to all 
arguments. 

Henceforth, we use the following notations. We denote the sequence of inputs 
(u(to), ■ ■ ■, u(ti)) by u[to,ti]. The sequence of the state (x(to ),..., x(t\)) is 
denoted as X\to,t\ ;u,9\, where the symbols u, 9 have been added to emphasize 
their effect. Although u[t 0 ,ti] and X[to,ti;u,0] are sequences of vectors with 
length — to + 1, we sometimes identify them with vectors in ]]$"■« ( t i— t o+ 1 ) and 
*o+i) ^ respectively. 

The solution of m at t = ti initialized at t = t 0 with x(f 0 ) is denoted 
by tp(ti,to,x(to);u,6). The symbols B{x,p) and B(x,p) denote the open and 
closed balls centered at x with radius p. For a sequence u[to, ti], B (u[to, t\], p) 
denotes the set {v[to,t\] : Vf £ {to, ■ ■ ■ ,U},v(t) G B(u(t),p)}. The symbol N 
denotes the set of nonnegative integers. 

Let the target state be x*. Henceforth, we assume that the target state is 
finite-time reachable in the following sense, which is a parametric counterpart 
of those given in El- 

Assumption 1 Vx, V6 G fig, 3 N >0, 3m[0, N — 1], 


1. <p{N, 0, x; m, 6) = x*, 


2. rank 


d^p(N,0,x-,u,0) 

du[0,N-l] 


= n. 
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The first expression in Assumption [T] is the algebraic reachability, and the second 
expression is the nonlinear counterpart of the controllability rank condition. 
Combining them implies a certain kind of “uniform controllability” Em, which 
has an observability counterpart 1 *XfT)i. 

As for the parameter identification, we assume the existence of the following 
excitation signal. 

Assumption 2 3N, 3u[0, N — 1], Vx, Vd £ fig, rank = ng 

In what follows, we construct a controller with structure similar to block 
model predictive controllers EE53 together with parameter estimators based on 
nonlinear equation solvers. Although model predictive control is an application- 
oriented method, the use of this ‘block model predictive control’ structure in our 
adaptive controller has completely different objective. It is used as a theoretical 
tool to show that Assumption [2] serves as a ‘persistent excitation condition’ 
for a nonlinear system of the form ©■ Basically, our control strategy is as 
follows. Partition the time interval N into blocks of finite length (the length 
of each block is determined adaptively. ) Let t = T k be the beginning of the 
fc-th block. At this time instant, update the parameter estimate 9(T k ) using 
the entire sequence of past states. Then, obtain N k and u[T k , T k + N k — 1] such 
that <p(T k + N k ,T k ,x(T k );u,9(T k )) = x* or ip{T k + N k ,T k ,x{T k );u,9(T k )) £ 
Af(x*), where Af(x*) is a neighborhood of x*. Next, apply the input sequence 
u[T k , T k + N k — 1] to the system JTJ until t = T k + N k — 1 is in an open-loop 
fashion. 

To avoid the overuse of subscripts, henceforth, we employ the following sim¬ 
plified notations. First, 9(T k ) is rewritten as 9 k . For the parameter estimation, 
the entire sequence of states up to T k , X[l,T k ;u,9\ will be used, but what 
really matters is the dependence on 9 only; we rewrite this expression in the 
column vector form and let g k (9) = ((x(l)) T ,..., (x(T k )) T ) T , omitting unneces¬ 
sary variables to avoid confusion. Similarly, we rewrite (p(T k + N k , 0, x(0); u, 9) 
as h k (9). 

3 Main results 

We first consider the ideal case where solutions of nonlinear equations are avail¬ 
able exactly, and we then consider the case where numerical errors to the solu¬ 
tions of nonlinear equations do exist. It is to be emphasized, however, that the 
assumption that an exact solution of the nonlinear equation of the parameter 
estimate is available, that is, g k (9 k ) = g k {9), does not always imply that 9 k = 9 
because g k (9) is not always a global injection - Assumption [2] merely assures 
that it is a local injection. 

The first algorithm of adaptive set-point regulation is as follows. 

Algorithm 1 

(Initialization) Given x(0), let u[0, No — 1] be the excitation signal, To = 0, 
Ti = Nq, k = 1; apply u[0, No — l]to system JT]) to obtain x(Ti). 

(Loop) 
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if x(Tk) = X* then 
break; 
else 

Obtain 9 k £ fig that satisfy gk(9k) = g k (0); 

Obtain u[T k , Tk + Nk — 1] that satisfy hk(9k) = £*; 

Let Tk -|_i = ?fc + N^, 

Apply u[Tk,Tk+ 1 — 1] to the system dTJ to obtain x(T k + 1 ). 

Let k = k + 1; 

Theorem 1 Under the first condition of Assumption^ and Assumption [H Al¬ 
gorithm [7] terminates after finitely many iterations, and the state of m reaches 
to the target state x » provided that exact solutions of nonlinear equations are 
available. 


Proof First, note that our assumptions permit that Algorithm |T| is always fea¬ 
sible. 

We prove our assertion by contradiction. Suppose that Algorithm [l] never 
terminates after finitely many iterations. Then, the resulting sequence of the 
parameter estimate (Ok)ken is an infinite sequence in the compact set fig and 
hence, it has at least one limit point. Let 0$ be one of its limit points. 

We first prove that Mj,gj(9f) = gj(9). Because we have assumed that exact 
solutions to nonlinear equations are available, Mj, gj(9j) = gj(9). Moreover, for 
fci < k^, the relation between g kl (0) and g k2 (0) are given by 


9k 2 (6) 


( fffci ( 9 ) \ 

x(T kl +1) 


V 


Due to this structure, we call that g kl (9) is an initial segment of g k2 (9). Because 
(?D is a limit point, there is a subsequence (9k,)i^n of (Ok)ke n that converges 
to 0jj. For any j > 0, gj(9) is a continuous function of 9 , and Ml such that 
j < fo , gj(9k,) = gj(9) because gj(9k, ) is an initial segment of g kl (9). Since 
limi -,.00 9k, = j and gj is continuous, gj(9fj = gj(9). 

Next, we prove by contradiction that 37, Ml > 7, 9k, = 9 Suppose that Ml, 
31 > 7, 9k, 7 ^ Then, Me > 0, 39k,, 9k, £ B(6$,e) \ {9$}. Because gi (the first 
segment of g k ,) is C 1 and 4^- is of full rank, 

3c > 0, 3e > 0, (||6> fcl - 0#|| < e => \\gi(9 kl ) - fl , i(0#)|| > c\\9 k , - 0#||) ■ (2) 


This contradicts the assumption that gi(9k,) = gi(9) = gi(9$). Hence, (9k,)ie® 
converges to 9 g after finitely many iterations, and Ml > 7, 9k, = 9$. This also 
implies that there are infinitely many k such that 9 k = 0jj. 

Let k, k' be such that k < k' and 9 k = 9 k > = (9jt. We conclude our analysis 
by showing that x(T k + 1 ) = x*. To see this, we recall our parameter tuning and 
control mechanism. At the beginning of the fc-th block, the parameter estimate 
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is updated from 6 k -i to 9 k to satisfy gk{9k) = g k (9 j) = gk{9). The predicted 
trajectory based on 8k is g k +i(8 k ), and the control input is determined to make 
the last n components of gk+i{9k), <p{Tk+i, Tk, x(T k )', u, 9k), identical to the 
target state £*. At this state, superficially, it is not assured that gk+i{9k) = 
gk+i{9), where g k +\{9) corresponds to the actual trajectory. However, gk'{9 k ') = 
5fc'(%) = gk'(6), and g k +i(8 k >) = g k+1 (0$) = g k +i(9) is its initial segment. 
Therefore, (p(T k+1 ,T k ,x(T k );u,6 k ) = ip(T k+ i,T k ,x(T k )-,u,0) = x*. This is a 
contradiction because we have supposed that the algorithm never terminates 
after finitely many iterations. □ 

Next, we consider the case where solutions to nonlinear equations may con¬ 
tain numerical errors, that is, a numerical solution to a nonlinear equation 
g{9) = 0 (we temporally denote it by 9) satisfies ||</(0) — < 7 ( 0 ) || < e for some 
£ > 0 , but the size of £ may be arbitrarily specified by a numerical nonlinear 
equation solver — generally, such specification is possible by adequately tuning 
the termination condition of the solver, as far as the CPU time permits it. 

In Algorithm [1] where we have assumed exact solutions to nonlinear equa¬ 
tions, there has been no limitation on the length of the blocks and the amplitude 
of the inputs. They may be arbitrary, and the “exact solution” assumption ab¬ 
sorbs all of their effect. In contrast, for inexact solution cases, they should be 
upper-bounded by some constant. The existence of the upper bound (and hence, 
feasibility) is assured by the following lemma, which is a variant of Lemma 2 
in jUJ. 

Lemma 1 Under Assumption [3 for a fixed x, the length of the control block 
and the amplitude of the control inputs that drive x into the target state x * 
are uniformly bounded for all admissible parameters in fig in the following 
sense: 3N X > 0, 3p x > 0, V0 £ fig, 3N < N x , 3u[0,7V — 1] £ B°° (0, p x ), 
<p(N, 0, x; u, 9) = x *. 

Proof The proof is similar to that of Lemma 2 of m and hence, it is omitted. 

□ 

Henceforth, we assume the following. 

Assumption 3 For each x, N x and p x are known a priori. 

Our algorithm based on inexact numerical solution also applies the excitation 
signal of Assumption [2] to the system JlJ at the beginning of the first control 
block. We have not yet described the algorithm itself, but the function gi(9) of 
Algorithm |T] is independent of the algorithm and hence is already determined. 
In the proof of Theorem [l] we have used the fact that for a fixed 0#, © holds 
because rank = ng. Our inexact numerical solution counterpart requires its 
“uniform counterpart. ” 

Lemma 2 3e gi > 0, 3c gi > 0, V 0 i ,02 € fie, 

Pi - W < e gi =► |M0r) - 51 (Ml > c 9l ||0i - 6 >a||. 
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Proof The proof is by contradiction. Suppose that Ve > 0, Vc > 0, 39\,9 2 G fie, 
||— 021 | < £ and 

IISi(0i) - 3i(02)|| <c||0 1 -0 2 ||. ( 3 ) 

Let Jgi = and A min = min{||(J'pi)(0)i>|| : v G R" e ,||v|| = 1;0 G fie}. 
Because Jgi is continuous and of full rank, A m i n > 0. Let c = A^p-, and 
let (0i(k), 62 (h)) be the pair in fie that satisfies (O for e = 1/k. Because 
m does not include equality, 8 i(k) ^ 8 2 (k). Because fie x fie is compact, 
(0i(fc),0 2 (fc))fceN has an accumulation point (0y,0(j). By Taylor’s formula and 
the assumption that fie is convex, gi{9 2 ) — Si($i) = (i?3i)(0i, 0 2 ,p)(9 2 — 61 ), 
where p = {jp \,..., p ne ) G IT 1 ® [0,1] and 


(Rgi)(0 1 ,d 2 ,p) 


( 


dg 1,1 

dS 


Pi02+(1-Pi)0i 




d 9 

d 6 


Pn e 0 2 + (1-Pn„)01 / 


Because Rg\ is continuous and its domain is compact, it is uniformly continuous, 
and (Rgi)(0$,9ft,p) = (Jgi)(8$). Therefore, Ve > 0, 35 > 0, 


max{||0 i -0| J ||} <5=» \\{Rg 1 )(8 1 ,9 2 ,p) - (J5i)(0«)ll < £• ( 4 ) 

1 = 1,2 


Let (9i(k), 0 2 (k)) be the pair that satisfies (0|) for e < Amis.. Then, since 

9 Mk)) - gi{ 6 i(k)) = (JgiM)(0 2 {k) - fli(fc)) 

+ ((Rgi)(9 1 ,9 2 ,p) - (JgiM))(9 2 (k) - 9 1 (k)), 

it follows that \\gi(9 2 (k)) — gi(9i(k))\\ > A™i||0 2 (fc) — 0i(A:)||, contradicting ([3]). 

□ 

Now, we describe the algorithm. In our algorithm, the numerical error of 
the solutions of nonlinear equations are treated by a method that is similar to 
the trust-region method of nonlinear programming | 21 j . 

Algorithm 2 

(Initialization) Given a;(0), choose a constant /3 (0 < /? < 1), go > 0, ko > 0, 
and £fi n > 0. Let u[0, No — 1] be the excitation signal, T 0 = 0, T) = Nq, k = 1; 
Apply u[0, N 0 — 1] to the system Jl]) to obtain x(T\). 

(Loop) 

if ||x(T fe )|| < £ fin then 
break; 
else 

g = (3g k -i; 


while 1 do 

Obtain 9k G fig that satisfy \\gk(9k) — <?fc(0)|| < g; 
Obtain u[Tk, Tk + Nk — 1] that satisfy: 
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• N k < iV x ( Tfe ), 

• u[T k ,T k + N k -l]e B°° (0, p x ( Tk) ), 

• || h k (9 k ) - a;* || < £§"■; 

if h k (B(9 k , K k p)) C B(h k (6 k ), then 

9k = m ; 

break; 

else 

9 = & 9 \ 

T k +i = T k + N k ; 

Apply u[T k ,T k + N k — 1] to system (0 to obtain x(T k+ \). 

k = k + 1; 

Theorem 2 Under Assumptions 0 0 and 0 Algorithm 0 terminates af¬ 
ter finitely many iterations, and the state of m reaches to the neighborhood 
B( a;*,£fi n ) of the target state x *. 

Proof We first prove that Algorithm 0 is feasible. Assumptions 0 and 0 make 
all steps inside the while loop feasible, except for the condition 

h k (B(8 k , n k g)) C B(h k (0 k ), (5) 

The analysis of h k (9 k ) needs some care, because it is the abbreviation of the 
function p(T k + N k ,T k ,x(T k )-,u,9 k ). However, since N k is bounded by N x (x k ), 
the amplitude of u is bounded by p x (T k ), and p is C 1 , for a positive constant 
c(x(N k )) that depends on x(N k ), || h k {9) — h k (9')\\ < c(a;(-/Vfc))||0 — 9'\\ for all 
9,9' 6 flfl. If (0) fails, the minor loop of the while loop of Algorithm 0 makes 
9 = Pp, 0 < < 1. Thus, residually, p < mm {tcMjv t ))} > and © is fulfilled. 

Next, we prove by contradiction that Algorithm 0 terminates after finitely 
many steps. Suppose that the termination condition of the (Loop) part of 
Algorithm 0 is never fulfilled. Then, an infinite sequence of the parameter 
estimate {9 k ) k e pj is obtained. In this case, the fourth line of (Loop) makes 
9k < Ppk -1 (in fact, with the iteration of the while loop, p k = fd dk ~ 1 p k -i for 
some d k -i > 1. ) Thus, the sequence (p k )ke n converges to zero. Contrary, 
by the execution of the fifth line of (Loop), n k = and kq > 0; hence the 

sequence {K k ) k ^n diverges to infinity. Because 9 k £ fig for each k and fig is 
compact, the sequence (9 k ) ke n has accumulation points in fig. Let L be the set 
of all accumulation points of (9 k ) kG j^. For q £ L, there is a subsequence (8 kl )i & n 
that converges to q. For all j, 3ki > j, and because g 3 is an initial segment of 
9k, for j < ki, 


IISj(0fci) ~9j(0))\\ < \\9k,{0 kl ) - g kl {9)\\ < 9k, ■ 

Because p kl converges to zero and g 3 is continuous, lim;^^ \\9j{9k,)-gj{0))\\ = 
II 9j (?) ~ 9j(9)\\ = 0. Hence, 

Vq£L,\/j,g j (q)=g j (8). ( 6 ) 
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Next, let L(e) = U ge z,i3(g,e) for some e > 0. Then, we can show that 

Ve, 3k ai Vk > k a ,d k G L{e). (7) 


To see this, let us suppose contrary: 3e,Vfc a ,3fc > k a ,0k & L(e). Then, (9 k )keN 
has an accumulation point in Qg \ L(e), contradicting the assumption that L 
is the set of all accumulation points. Let e gi and c gi be constants defined 
in Lemma [5] Choose a k a that satisfies 0 for e = e gi . Because (nk)keM 
diverges to infinity, 3 kb, V/c > kb, n k > —. Let k > max{fc„, fed. Let qk = 

c g i 

arginine \\6 k - g||. Then, \\9 k - q k \\ < £ gi - Hence, by Lemma [2] \\9 k - qk || < 
T-\\gi{9 k ) - 9 i{qk)\\i and because K k > \\9 k - ?fc|| < K k \\gi{9 k ) ~ gi(q k )\\- 

Moreover, by ©, gi(q k ) = 9 i(9 ), and with the first execution of the statement 
inside the while loop of Algorithm S \\gi(9 k ) - gi{9)\\ < || g k {6 k ) - g k {9 )|| < Hk- 
Thus, || 9 k - qk || < Kk9k, and hence, h k {q k ) C B(h k {9 k ), ^)■ Because h k {9 k ) G 
B{x*, h k (qk) G B(x*,£fi n ), which shows that the termination condition of 

(Loop) has already been fulfilled at the k + 1-th step; a contradiction. □ 

4 Conclusion 

In this paper, the finite-time adaptive set-point regulation problem for discrete- 
time nonlinear systems with parametric uncertainty has been solved under the 
assumption that the target state is reachable provided that the parameter is 
known and an excitation signal is available. 

The proposed controller has a pathological structure that all history of the 
past state is preserved until the state reaches to the target state. Moreover, 
in Algorithn0 it is not easy to obtain estimates of N x .r Tk ) and p x rr k )- Hence, 
the proposed algorithms are computationally extremely demanding and by no 
means practical. They should be regarded as being of purely theoretical and 
conceptual nature. On the other hand, in order for the proposed algorithms to be 
applicable, except for the reachability to the target state, no additional condition 
is required. This contrasts to the majority of existing methods of nonlinear 
adaptive control, where many structural conditions are required in order for 
those methods to be applicable. Thus, the implication of this paper is to show 
the potential of the concept of nonlinear adaptive control in the sense that no 
extra condition other than the reachability to the target state is required in order 
to construct a stable nonlinear adaptive controller provided that sufficiently fast 
and reliable nonlinear minimizer or nonlinear equation solver is available. In this 
respect, nonlinear adaptive control problem is reduced to nonlinear optimization 
problem. An extra bonus of the proposed methodology is that it is completely 
“Lyapunov-free. ” 

From a practical point of view, it is desirable to develop a more down-to- 
earth algorithm that has less computational complexity but does not necessitate 
extra conditions other than the reachability to the target state. It is also to be 
noted that the proposed algorithms have the drawback that they are not robust 
against disturbances. To overcoming these problems is left for further research. 
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